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United States Patent and Trademark Office 
P.O. Box 2327 
Arlington, VA 20231 

Dear Sir; 



Applicant respectfully requests that the Examiner enter the following amendments and 
consider the following remarks. 



IN THE SPECIFICATION: 

Please amend the paragraph at page 1, line 9 to line 14 as follows: 

This application is a continuation of U.S. Application No. 10/010,579, filed November 8, 
2001, which is a continuation of U.S. Application No. 09/134,500, filed August 14, 1998, which 
are hereby incorporated by reference. The subject matter of U.S. patent applications: Serial No. 
09/134,498, filed August 14, 1998 and entitled "VIDEO CATALOGER SYSTEM WITH 
EXTENSIBILITY"; Serial No. 09/134,499, filed August 14, 1998 and entitled "VIDEO 
CATALOGER SYSTEM WITH HYPERLINKED OUTPUT"; and Serial No. 09/134,497, filed 
August 14, 1998 and entitled "VIDEO CATALOGER SYSTEM WITH SYNCHRONIZED 
ENCODERS" are related to this appUcation. 
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IN THE CLAIMS: 

Please add the following claims: 

18. An audio engine for extracting metadata tracks, comprising: 
an audio signal switch receiving an audio signal; 

an audio classification component in data communication with and controlling the 
audio signal switch according to whether the audio signal is classified as speech; and 

a plurahty of audio metadata track extraction components in data communication 
with the output of the switch, wherein each audio metadata track extraction component 
provides an audio metadata track associated with speech. 

19. The audio engine of Claim 18, wherein the audio metadata tracks include at least 
speaker identification. 

20. The audio engine of Claim 18, wherein the audio classification component 
additionally classifies at least music. 

21. The audio engine of Claim 18, wherein the audio metadata track extraction 
components receive data firom a customizable dictionary of data associated with the extracted 
metadata tracks. 

22. The audio engine of Claim 18, wherein the audio signal is received fi"om a remote 
real-time source. 

23. The audio engine of Claim 18, wherein the audio signal is received from a remote 
digital source. 

24. A method of extracting audio for indexing of video, comprising: 

receiving video information having embedded audio information and associated 
time codes; 
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capturing the embedded audio infonnation in the video information; 

extracting a plurality of audio metadata tracks from the audio information, each 
audio metadata track being associated with selected ones of the time codes indicative at 
least of start and stop times for the audio metadata track; 

encoding the video infonnation; and 

accessing the encoded video information with the selected time codes of one of 
the audio metadata tracks. 

25. The method of Claim 24, wherein the video information is received from a remote 
digital source. 

26. The method of Claim 24, wherein the plurality of audio metadata tracks includes 
at least one of: keywords, speech-to-text transcription, speaker identification and audio class. 

27. An audio engine for extracting metadata tracks, comprising: 
an audio signal switch receiving an audio signal; 

an audio classification engine; 

an audio class dictionary configured to provide dictionary data indicative of audio 
classes to the audio classification engine; 

an audio class profiler in data communication with the audio classification engine, 
wherein the audio class profiler receives the audio signal, and wherein the audio class 
profiler is fiirther in data communication with and controls the audio signal switch 
according to whether the audio signal is classified as speech; and 

a plurality of audio metadata track extraction components in data communication 
with the output of the switch, wherein each audio metadata track extraction component 
provides an audio metadata track associated with speech. 

28. The audio engine of Claim 27, additionally comprising: 

an audio capture component for capturing and digitizing an analog audio source; 

and 
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an audio signal normalization component for normalizing the digitized audio prior 

to processing. 

29. The audio engine of Claim 27, wherein the audio metadata tracks include at least 
one of: keywords, speech-to-text transcription and speaker identification. 

30. The audio engine of Claim 27, wherein the audio class profiler additionally 
classifies at least silence and music. 

31. The audio engine of Claim 27, wherein the audio metadata track extraction 
components receive data fi-om a customizable dictionary of data associated with the extracted 
metadata tracks. 

32. The audio engine of Claim 27, wherein the audio signal is received from a real- 
time source. 

33. The audio engine of Claim 27, wherein the audio signal is received from a digital 

source. 

34. The audio engine of Claim 27, wherein the audio signal is received from a digital 
camcorder. 

35. The audio engine of Claim 27, wherein the audio class dictionary is customizable. 

REMARKS 

The Related Applications section of the specification is amended to add the appUcation 
numbers of the related appUcations. New Claims 18-35 have been added and Claims 1-17 remain 
unchanged. Claims 1-35 are pending in the application and are presented for reconsideration. 

The specific changes to the specification are shown on a separate page attached hereto and 
entitled VERSION WITH MARKINGS TO SHOW CHANGES MADE , which follows the 
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signature page of this Amendment. On this page, the insertions are double underlined while the 
d e l e tions are struck through . 



CONCLUSION 

Applicant believes that the claims are patentable. However, if the Examiner finds any 
impediment to allowing all claims that can be resolved by telephone, the Examiner is respectfully 
requested to call the undersigned. 

Please charge any additional fees, including any fees for additional extension of time, or 
credit overpayment to Deposit Account No. 1 1-1410. 

Respectfully submitted, 

KNOBBE, MARTENS, OLSON & BEAR, LLP 




Raimond J. Salenieks 
Registration No. 37,924 
Agent of Record 
620 Newport Center Drive 
Sixteenth Floor 
Newport Beach, CA 92660 
(619) 235-8550 
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VERSION WITH MARKINGS TO SHOW CHANGES MADE 

In the Specification: 

The paragraph at page 1, line 9 to line 14 has been amended as follows: 

This a pnlication is a cotitinuation of U.S. Applica tion No. 10/010.579. filed November 8. 
2001 . which is a continuat ioTi of U.S. Application No. 09/1 34.500. filed August 1 4. 1998. which 
are hereby incorporated bv reference. The subject matter of U.S. patent applications: Serial No. 
—09/134.498. filed August 14, 1998 and entitled "VIDEO CATALOGER 

SYSTEM WITH EXTENSIBILITY"; Serial No. 09/134.499. filed August 14, 

1998 and entitled "VIDEO CATALOGER SYSTEM WITH HYPERLINKED OUTPUT"; and 

Serial No. 09/134.497 . filed August 14, 1998 and entitled "VIDEO 

CATALOGER SYSTEM WITH SYNCHRONIZED ENCODERS" are related to this 
application. 
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